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ABSTRACT 

The  purpose  of  this  paper  is  to  describe  current  work  in  specification  and  deveiopment  of  Web-based 
3D  standards  and  toois.  The  paper  presents  a  Web3D  appiication  for  miiitary  education  and  training 
currentiy  in  progress  for  the  Defense  Modeiing  and  Simuiation  Office  and  the  Marine  Corps  Combat 
Deveiopment  Command. 

Web-based  3D  content  deveiopment  toois  continue  to  evoive.  The  Web3D  Consortium 
(http://www.web3d.ora)  promotes  the  specification  and  deveiopment  of  toois  for  expioiting  3D  graphics  in 
the  Worid  Wide  Web.  Current  work  is  focused  on  deveioping  the  next-generation  specification  for 
Web3D,  referred  to  as  Extensibie  3D  (X3D  -  http://www.web3d.ora/x3d.htmi).  X3D  is  a  scene  graph 
architecture  and  encoding  that  improves  on  the  Virtuai  Reaiity  Modeiing  Language  (VRML)  internationai 
standard  (VRML  97,  ISO/IEC  14772-1:1997).  X3D  uses  the  Extensibie  Markup  Language  (XML)  to 
express  the  geometry  and  behavior  capabiiities  of  VRML.  Primary  target  appiications  for  X3D  are 
eiectronic  commerce  product  and  technoiogy  demonstration,  visuai  simuiation,  database  visuaiization, 
advertising  and  web  page  animation,  augmented  news  and  documentaries,  training,  games, 
entertainment,  and  education.  This  paper  discusses  how  X3D  wiii  address  shortcomings  of  VRML  97, 
VRML  97  compatibiiity,  interoperation  with  other  reievant  standards,  tighter  media  integration,  improved 
visuai  quaiity,  component-based  approach,  fiie  format  issues,  and  time  to  market.  The  paper  wiii  aiso 
present  the  current  progress  of  the  X3D  Working  Group  in  deveioping  the  runtime  core  specification, 
component  specifications,  advanced  graphics  extensions  (inciuding  GeoVRML  for  geographic 
representations  and  H-Anim  for  humanoid  modeis),  XML  3D  tags  definition,  text  fiie  format,  binary  fiie 
format,  conversion  and  transformation  of  existing  VRML  97  content,  conformance  testing, 
demonstrations,  and  impiementations. 

The  Defense  Modeiing  and  Simuiation  Office  (DMSO)  and  Marine  Corps  Combat  Deveiopment 
Command  (Training  and  Education  Command)  have  tasked  the  Navai  Postgraduate  Schooi  (NPS)  to 
perform  research  toward  deveiopment  of  a  scenario  authoring  and  Web-based  visuaiization  capabiiity. 
Prototyping  activities  are  empioying  Web-based  technoiogies  for  information  content  (XML)  and  3D 
graphicai  content  (X3D)  to  create  an  initiai  presentation  of  an  amphibious  operation.  The  envisioned  fuii 
capabiiity  wiii  represent  criticai  aspects  of  the  battiespace,  such  as  terrain,  force  dispositions, 
maneuvers,  fires,  coordination  measures,  and  timing.  This  paper  discusses  technicai  chaiienges  in 
representing  compiex  miiitary  operations  in  Web  environments  and  describes  work  in  progress  to 
demonstrate  appiication  of  Web-based  technoiogies  to  create  and  expiore  compiex,  muiti-dimensionai 
operationai  scenarios.  The  paper  describes  appiication  of  the  capabiiities  into  other  education  and 
training  domains. 
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PREFACE 

Extraordinary  growth  in  3D  graphics,  Web 
accessibiiity,  and  networking  presents  new 
opportunities  for  education.  Personai  computing 
and  data  storage  resources  are  no  ionger 
confined  to  desktops  or  Locai-Area  Network 
(LAN)  resources,  but  extend  to  the  myriad 
processing  and  storage  resources  interconnected 
worid-wide.  This  extended  computing  medium 
continues  to  have  a  revoiutionary  impact  on  the 
way  we  work,  iearn,  recreate,  interact,  conduct 
business,  and  store  and  retrieve  information. 

What  is  perhaps  even  more  startling  is  that 
systems  taking  advantage  of  this  new  network¬ 
centric  paradigm  remain  largely  two-dimensional 
(2D),  while  problems  of  interest  continue  to  be 
decidedly  three-dimensional  (3D).  In  real  life, 
individuals  are  comfortably  immersed  within  and 
can  freely  navigate  3D  physical  space. 
Nevertheless,  despite  25  years  of  graphics 
research  and  a  long  line  of  competing  proprietary 
technologies,  creating  compelling  3D  virtual 
spaces  is  usually  problematic.  To  date, 
interactive  3D  graphics  are  noticeably  missing 
from  day-to-day  production  systems  and  most 
online  web  pages. 

This  paper  presents  current  efforts  in  Web- 
based  3D  technology  by  one  key  organization, 
the  Web3D  Consortium  (http://www.web3d.ora). 
In  a  pioneering  endeavor,  the  Web3D 
Consortium  is  working  to  open  the  Web-based  3D 
frontier  to  all  by  charting  the  territory,  establishing 
shared  goals,  and  building  lines  of 
communication.  The  paper  also  describes  efforts 
of  the  Modeling,  Virtual  Environments,  and 
Simulation  (MOVES)  Institute  at  the  Naval 
Postgraduate  School  (NPS)  to  introduce 
emerging  Web3D  technology  into  the  forefront  of 
military  professional  education.  Specific 
techniques,  models,  and  scenarios  are  presented 
from  the  Scenario  Authoring  and  Visualization  for 
Advanced  Graphical  Environments  (SAVAGE) 
project  at  NPS. 


INTERACTIVE  3D  GRAPHICS  ON  THE  WEB 

Creation  of  3D  model  geometry,  materials, 
lighting,  and  rendering  are  generally  well- 
understood  technologies  (see  Foley,  van  Dam, 
Feiner,  and  Hughes,  1990).  Current  graphics- 
acceleration  hardware  has  eliminated  previous 
frame-rate  impediments  and  many  complex 
scenes  are  now  rendered  quickly  and  stunningly. 
As  more  and  more  people  utilize  3D  worlds,  user 
interactivity  becomes  a  dominant  requirement. 
There  are  four  key  aspects  to  interactivity  in  3D 
graphical  content: 

Movement  -  objects  in  the  scene  can  move 
independently,  relative  to  each  other  and 
relative  to  the  viewer’s  viewpoint 

Navigation  -  the  viewer  can  effectively  look 
about  and  move  within  the  scene,  without 
getting  disoriented  or  “lost  in  cyberspace” 

Responsiveness  -  the  viewer  can  initiate 
object  changes  and  trigger  embedded 
behaviors  and  motions  within  a  scene, 
usually  based  on  realistic  physics  or  plausible 
logic 

World  models  -  a  significant  amount  of  world 
information  is  available,  either  via  a  local 
database  or  via  shared  network  resources 

Through  these  characteristics,  the  viewer  is  not 
constrained  to  remain  a  passive  observer  of  the 
rendered  scene,  but  can  also  become  an  active 
participant  in  the  scene.  Together  these 
characteristics  help  the  viewer  attain  a  sense  of 
autonomy,  immersion  and  presence  in  the  3D 
scene  (Zeltzer,  1992). 

The  phrase  ‘Web3D  content”  refers  to  3D 
graphics  rendered  via  a  web  browser,  such  as 
Microsoft  Internet  Explorer  or  Netscape 
Navigator.  3D  content  needs  to  be  as  easy  to 
access  and  view  in  a  browser  as  2D  text  and 
graphics  in  a  Hypertext  Markup  Language 
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(HTML)  document  are  today  if  similar  scalability, 
ubiquity,  and  “ease  of  use”  are  to  be  attained. 

3D  content  must  be  accessible  via  networked 
browsers  in  order  to  grow  and  interconnect 
without  bound.  This  is  different  from  the 
separate-program  installation  methodology 
required  by  most  standalone  or  large-scale  multi¬ 
player  online  games.  For  commercial  reasons 
(i.e.,  billing),  most  large-scale  commercial  online 
games  are  separate  customized  applications  that 
only  allow  authenticated  users  to  join  and  depart 
distributed  virtual  environments.  In  return,  such 
shared  applications  provide  state  management 
and  communications  among  the  host  servers  and 
other  players.  The  application  further  provides 
specialized  (usually  proprietary)  graphics 
rendering  that  only  utilizes  3D  content  that  is 
uniquely  prepared  for  that  application.  While  this 
is  an  effective  business  model  for  online  gaming, 
it  is  not  a  very  scalable  or  robust  approach  for 
long-term  military  and  scientific  applications  that 
must  steadily  grow  and  improve  (and  perhaps 
even  interoperate). 

Open,  scalable,  nonproprietary  Web-based 
3D  graphics  technologies  are  available  today. 
For  example.  Figure  1  shows  a  screen  capture 
from  a  multi-player  research  game  developed  at 
the  Naval  Postgraduate  School  to  study  Web3D 
issues  as  well  as  broader  networked  virtual 
environment  (NVE)  architectural  questions.  The 
application  was  implemented  using  Distributed 


Figure  1.  Multiple  helicopters,  tanks  and 
humanoid  avatars  move  and  interact  within 
the  NPS  Capture-the-Flag  research 
application,  a  synthetic  battlespace  on  Fort 
Irwin  terrain  (45x55km^),  rendered  here 
using  Netscape  Navigator,  CosmoPlayer 
VRML  3D  plug-in,  and  DIS-Java-VRML 
networking. 


Interactive  Simulation  (DIS),  the  Java 
programming  language,  and  Virtual  Reality 
Modeling  Language  (VRML)  standards  for 
maximal  interoperability. 

WEB3D  CONSORTIUM 

The  Web3D  Consortium  Incorporated  is  a 
nonprofit  organization  dedicated  to  the  creation  of 
open  standards,  specifications  and  recommended 
practices  for  Web3D  graphics 
(http://www.web3d.ora).  The  Web3D  charter  goal 
is  to  accelerate  the  worldwide  demand  for 
products  based  on  these  standards  through  the 
sponsorship  of  market  and  user  education 
programs.  The  VRML  community  and  the  Web3D 
Consortium  led  the  development  of  specifications 
for  versions  1.0  and  2.0  of  the  Virtual  Reality 
Modeling  Language  (VRML),  which  became  an 
international  standard  through  the  International 
Standards  Organization  (ISO)  (VRML,  1997). 
Through  various  open  Teams  and  Working 
Groups,  consortium  members  and  the  3D- 
graphics  community  focus  on  Web3D  standards 
and  technologies  to  promote  evolution  of 
capabilities  that  will  help  bring  Web3D  into  the 
mainstream  of  online  experience. 

From  the  perspective  of  the  Web3D 
Consortium,  ‘Web3D”is  an  overarching  term  to 
describe  protocols,  languages,  file  formats,  and 
other  technologies  that  are  used  to  deliver 
compelling  3D  content  over  the  World  Wide  Web 
(Walsh  and  Bourges-Sevenier,  2001). 
Established  in  1994,  the  Web3D  Consortium 
today  consists  of  leading-edge  companies  and 
technical  experts  from  around  the  world  working 
together  to  design,  develop,  and  promote  open, 
interoperable,  and  standardized  technologies. 
Taken  together,  such  works  comprise  ‘Web3D.” 
The  Web3D  Consortium  sponsors  symposia  and 
operates  numerous  mailing  lists  for  ongoing 
technical  exchange  on  questions  and  issues 
relating  to  Web3D  technologies  and  industry 
development. 

WebSD  Working  Groups  and  Teams 

Working  Groups  form  the  heart  of  the 
Web3D  consortium.  Here,  members  collaborate 
to  develop  Web3D  Recommended  Practices  (i.e., 
practices  recognized  as  the  official  position  of  the 
Consortium,  but  not  yet  advanced  to  ISO  as  an 
official  specification),  standards,  tools,  and 
technologies.  The  Working  Groups  operate  under 
the  jurisdiction  of  one  or  more  of  the 
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Consortium's  Teams  (Commercialization, 
Specification,  Implementation  and 

Communication). 

The  wide  scope  of  the  Web3D  Consortium  is 
evident  in  the  topics  addressed  by  the  following 
sampling  of  currently  active  Working  Groups. 
The  Web3D  Consortium  web  site  provides  further 
detail  on  all  Working  Groups. 

Extensible  3D  (X3D)  Specification  -  design, 
develop,  implement,  evaluate,  and 
standardize  the  X3D/VRML  200x 
specification. 

Source  Code  Management  -  manage  and 
develop  open-source  and  community-source 
code  contributions  including  the  Xj3D  (Java- 
based)  loader/browser  and  blaxxun’s  Contact 
(C-r-i-  based)  browser. 

GeoVRML  -  determine  methods  for 
representing  geo-referenced  data  in  VRML, 
and  develop  tools.  Recommended  Practices, 
and  standards  necessary  to  generate, 
display,  and  exchange  such  data.  GeoVRML 
1.0  is  currently  a  Web3D  Consortium 
Recommended  Practice. 

Humanoid  Animation  (H-Anim)  -  create  a 
standard  VRML  representation  for  humanoids 
(Figure  2;  Miller,  2000).  H-Anim  1.1  is 
currently  a  Web3D  Consortium 
Recommended  Practice. 


Figure  2.  A  team  of  humanoid  avatars, 
implemented  in  accordance  with  the  Web3D 
Consortium  H-Anim  Recommended  Practice, 
prepare  to  embark  on  a  helicopter  in  the 
NPS  Capture-the-Flag  research  application. 


Distributed  Interactive  Simulation  (DIS)  - 
establish  networking  conventions  for  building 
multicast-capable,  large-scale  virtual 
environments  (LSVEs)  (IEEE,  1996;  Katz, 
1998). 

Universal  Media  -  define  a  small,  cross¬ 
platform  library  of  locally  resident  media 
elements  (textures,  sounds,  and  VRML 
objects)  and  a  uniform  mechanism  by  which 
VRML  content  creators  can  incorporate  these 
media  elements  into  their  worlds. 

Virtual  reality  transfer  protocol  (vrtp)  - 
provide  client,  server,  many-to-many 
multicast  streaming  and  network-monitoring 
capabilities  in  support  of  internetworked  3D 
graphics  and  LSVEs. 

The  Web3D  Consortium  has  submitted 
Amendment  1  to  the  VRML  97  specification  with 
a  number  of  incremental  improvements.  The 
External  Authoring  Interface  (EAI)  specifies  a 
stable  interface  between  a  VRML  world  and  an 
external  Web  page.  GeoVRML  and  H-Anim  are 
formally  specified.  Clarifications  to  the  event 
model  and  miscellaneous  corrections  update  the 
VRML  97  specification  to  match  several  years  of 
progress  and  “lessons  learned.” 

True  to  the  Consortium’s  charter,  these 
initiatives  illustrate  the  commitment  of  the 
organization  to  defining  and  fostering 
technologies  that  will  enhance  the  online  3D 
experience  for  all  users. 

Virtual  Reality  Modeling  Language  (VRML  97) 

Simply  stated,  VRML  is  a  language  for 
describing  3D  scenes.  The  language  uses  the 
scene  graph  paradigm;  i.e.,  a  hierarchical 
decomposition  of  the  renderable  components  in  a 
scene.  Expressed  as  text,  VRML  files  are  readily 
accessible  over  the  Internet  and  can  be  written 
and  modified  using  simple  text  editing  software. 
Brutzman  (1998)  provides  a  good  overview  of 
VRML  language  features.  An  excellent  textbook 
covering  the  language  in  detail  is  the  VRML  2.0 
Sourcebook  by  Ames,  Nadeau,  and  Moreland 
(1997).  A  complete  technical  reference  is  the 
Annotated  VRML  2.0  Reference  Manual  (Carey 
and  Bell,  1997). 

Figure  3  shows  a  portion  of  a  scene  graph 
representation  of  a  Marine  Corps  amphibious 
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Figure  3.  Scene  graph  representation  of  a  Marine  Corps  amphibious  operation,  using  the 
IBM  Xeena  XML  Editor  configured  for  X3D.  Note  the  same  content  as  in  Figures  4  and  5. 


operation.  This  diagram  iiiustrates  the 
hierarchicai  structure  of  the  scene  graph. 
Subordinate  to  the  top-ievei  (root)  Scene  node, 
the  author  has  referenced  a  terrain  fiie  containing 
depiction  of  a  portion  of  the  Camp  Pendieton 
operating  area.  The  scene  inciudes  a  Landing 
Piatform  Dock  (LPD)  amphibious  ship  and  three 
Advanced  Amphibious  Assauit  Vehicies  (AAAV). 
In  each  case,  detailed  geometries  for  the 
platforms  (LPD  and  AAAVs)  are  imported  from 
external  files  using  the  Inline  node. 

The  landing  craft  are  collected  together  in  a 
Transform  node,  permitting  the  entire  group  to  be 
placed  and  animated  in  the  scene  as  an 
aggregate  entity.  Individual  positions  of  the 
landing  craft  relative  to  the  lead  vehicle  are 
animated  using  subordinate  Transform  nodes.  In 
this  fashion,  both  aggregate  and  individual  entity 
behaviors  and  physics  can  be  modeled 
simultaneously. 


An  excerpt  from  a  VRML  file  describing  the 
same  scene  is  shown  in  Figure  4.  Annotations  on 
the  figure  relate  language  constructs  to  the  same 
scene  elements  as  shown  in  Figure  3.  In  general, 
the  VRML  language  syntax  (e.g.  bracket  and 
brace  structures)  is  fairly  hard  to  learn  and  debug 
without  the  use  of  an  authoring  tool.  On  the  other 
hand,  a  strength  of  the  standard  is  that  graphical 
scenes  can  be  created  directly  through  text 
editing,  and  those  files  can  be  readily  shared  over 
the  net. 

Today,  authors  seldom  need  to  develop  3D 
content  using  a  text  editor  to  code  “raw”  VRML. 
Tools  such  as  the  XML-based  scene-graph  editor 
shown  in  Figure  3  make  construction  and 
understanding  of  VRML  scenes  much  easier.  In 
VRML/X3D  courses  taught  at  NPS  over  the  past 
3  years,  the  authors  have  witnessed  significant 
increases  in  student  progress  through  course 
materials  and  in  producing  complex  3D  models 
through  the  introduction  of  this  editing  tool  into 
the  classes. 
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Root  Node  (imolicit) 


#VRML  V2 . 0  Utf8 

#  X3D-to-VRML-97  XSL  translation  autogenerated  by  X3dToVrml97 .xsl 

#  http :  //www .  web3D .  org/TaskGroups/x3d/t ranslat ion/X3dToVrrrLl97  .  xsl 

#  [Scene] 

Navigationinfo  { 

avatarSize  [222] 
speed  100 

type  [  "EXAMINE"  "ANY"  ] 
visibilityLimit  60000 

} 

Viewpoint  { 

description  "Amphibious  raid  -  full  scenario  seen  from  above" 
orientation  -0.557  -0.799  -0.229  0.9506 
position  -600  10000  25000 

} 

Viewpoint  { 

description  "1000m  elevation  view" 
orientation  0  1  0  -0.78 
position  -200  1000  22000 

} 

Switch  { 

whichChoice  0 
choice  [ 

DEE  EntireScene  Group 
children  [ 

Transform  { 
children  [ 

Inline  { 

url  [  ". ./. . /Locat ions/CampPendletonCalif ornia/CampPendletonOperatingAreasExample . wrl " 

"http : //web . nps . navy . mil/ -brut zman/ vrml/examples/NpsMilitaryModels /Locat ions /CampPendletonCalifornia/CampPendletonOperat 
ingAreasExample . wrl " 


] 


Amohibious  Ship 


} 

DEE  LPD  Transform  { 

translation  6600  10  16800 
children  [ 

Inline  { 

url  [  "../.. /Ships/LandingPlat f ormDock-LPD/LPD . wrl " 

"http : //web . nps . navy . mil/ -brut zman/vrml/examples/NpsMilitaryModels /Ships /LandingPlat  formDock-LPD /LPD . wrl " 


} 

DEE  AAAV-Location  Transform  { 
translation  6600  0  16800 
children  [ 

Viewpoint  { 

description  "Triple  AAAV  Raid" 
orientation  010  -1.57 
position  -40  2  0 

} 

Transform  { 

translation  0-40 
children  [ 

DEE  AAAV  Inline  { 

url  [  "../.. /AmphibiousVehicles/AAAV/AAAV. wrl" 

"http : //web . nps . navy . milZ-brut zman/vrml/examples/NpsMilitaryModels / AmphibiousVehicles /AAAV/ AAAV. wrl " 


] 

} 

Group  { 

children  [ 

Transform  { 

translation  -15  -4  -1 
children  [ 

DEE  AAAV-3  Transform 
children  [ 

USE  AAAV 


DEE  AAV-3PATH  Positioninterpolator  { 
key  [  0.00,  0.07,  0.13,  0.22,  ...  ] 
keyValue  [0.0  0.0  0.0,  1.0  0.96  1.0, 


] 

} 

Transform  { 

translation  -15  -4  15 
children  [ 

DEE  AAAV-2  Transform  { 


Figure  4.  Excerpt  from  a  VRML  file  describing  a  Marine  Corps  amphibious  operation.  Note  that 
the  same  content  is  being  described  as  in  Figures  3  and  5. 
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Since  establishment  of  VRML  as  an 
international  standard  in  1997,  numerous 
authoring  and  rendering  tools,  including  plug-ins 
for  common  Internet  browsers,  have  been 
developed  and  made  available  to  the  public  as 
freeware  or  commercial  products.  In  addition, 
many  3D  authoring  products  now  provide  the 
capability  to  import  and  export  VRML  formatted 
files,  enhancing  interoperability  across  multiple 
formats.  All  of  these  aspects  have  contributed  to 
VRML  becoming  the  most  widely  used  form  of 
Web3D  on  the  Internet  today  (Walsh  and 
Bourges-Sevenier,  2001). 

EXTENSIBLE  3D  (X3D) 

The  next-generation  specification  for  VRML 
is  the  Extensible  3D  (X3D)  standard  (see 
http://www.web3d.ora/x3d.html).  X3D  is  a  scene 
graph  and  text-based  encoding  designed  to 
overcome  several  limitations  of  the  VRML 
standard.  X3D  uses  the  Extensible  Markup 
Language  (XML)  to  express  identical  VRML 
geometry  and  behavior  structures.  X3D  is  thus  a 
backwards-compatible  XML  tagset  for  describing 
the  VRML  200x  standard  for  Web-capable  3D 
content.  Such  content  is  not  static  but  dynamic, 
driven  by  a  rich  set  of  interpolators,  sensor 
nodes,  scripts,  and  behaviors. 

An  excerpt  from  an  X3D  file  is  shown  in 
Figure  5.  The  XML  tags  in  the  example 
correspond  to  the  scene  graph  example  in  Figure 
3  and  the  VRML  excerpt  in  Figure  4.  In  fact,  the 
VRML  content  in  Figure  4  was  generated  directly 
from  the  X3D  file  shown  in  Figure  5.  The 
conversion  stylesheet  from  one  format  to  the 
other  was  written  using  Extensible  Stylesheet 
Language  Transformation  (XSLT;  see  Deitel, 
Deitel,  Nieto,  Lin,  and  Sadhu,  2001).  This  is  part 
of  the  power  behind  using  an  XML  representation: 
XML  describes  the  3D  scene  as  structured  data, 
which  can  be  processed  without  paying  attention 
to  how  the  data  should  be  presented.  In  this  case, 
it  describes  3D  content,  but  that  content  need  not 
be  rendered  as  a  3D  scene.  Through  different 
XSL  files,  the  content  in  an  X3D/XML  file  may  be 
converted  to  VRML  (as  shown  above),  to  pretty- 
printed  HTML  (see  Figure  6),  or  to  any  number  of 
other  formats  (including  source  code). 

Expression  of  VRML  scenes  in  XML  enables 
application  of  a  wide  range  of  existing  and 
emerging  XML-based  tools  for  transformation, 
translation,  and  processing.  XML  is  rapidly 
transforming  the  Web  from  a  vast  document 


repository  to  a  vast  data  repository  (Goldfarb  and 
Prescod,  2001).  XML  provides  numerous  benefits 
for  extensibility  and  componentization.  It  is  also 
important  to  note  that  XML  forms  the 
infrastructure  of  the  Web-Enabled  Navy 
Architecture  (Task  Force  ‘W’,  2001),  forming  the 
link  between  data  content,  applications,  and 
presentation.  For  X3D,  XML  further  provides  the 
ability  to  develop  well-formed  and  validated 
scene  graphs,  an  extremely  valuable  constraint 
since  “broken”  3D  content  would  no  longer  be 
allowed  to  escape  onto  the  Web  where  it  might 
cause  larger  scenes  to  fail. 

Primary  target  applications  for  X3D  are  e- 
commerce  product  and  technology 
demonstration,  visual  simulation,  database 
visualization,  advertising  and  web  page 
animation,  augmented  news  and  documentaries, 
training,  games  and  entertainment,  virtual 
characters,  and  education.  This  list  was 
developed  after  months  of  surveys  and  extensive 
discussions  by  the  Web3D  Consortium,  and  still 
holds  true.  Of  interest,  the  Consortium  could  not 
identify  a  single  “killer  application”  that  trumps  all 
others.  Instead,  3D  graphics  has  a  great  variety 
of  application  areas  which  all  need  to  be 
supported  in  combination.  This  situation  provides 
significant  guidance  to  X3D  language  designers. 

X3D/VRML  200x  is  capable  of  compatibly 
using  all  legacy  VRML  97  content.  X3D  provides 
new  interoperability  with  other  relevant  standards 
including  MPEG-4  and  an  entire  family  of  XML- 
based  languages.  X3D  further  addresses  several 
shortcomings  of  VRML  97,  provides  tighter  media 
integration,  improved  visual  quality  through 
advanced-rendering  nodes,  and  enables  a 
component-based  approach.  Combined  binary 
and  geometric  compression  has  been  deferred 
until  other  X3D  deliverables  are  complete. 

A  huge  set  of  conformance  examples  now 
enable  browser  companies  and  users  to  validate 
both  content  and  rendering  capabilities.  The 
Web3D  VRML/X3D  Conformance  Test  Suite 
integrates  a  body  of  work  that  originated  from  the 
National  Institute  of  Standards  and  Technology 
(NIST)  VRML97  Conformance  Suite,  and  adds 
several  new  tests  for  new  nodes.  Those  tests  are 
now  available  in  XML  format,  allowing  the  tests  to 
evolve  with  the  VRML  and  X3D  specifications. 
The  test  suite,  consisting  of  approximately  850 
tests,  allows  a  viewer  to  evaluate  a  VRML/X3D 
browser  by  simply  browsing  through  a  CD  (or 
online  directory)  of  documented  tests.  Tests  are 
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with  all  players. --> 


Terrain  Reoresentation 


<?xml  version=" 1 . 0 "  encoding="UTF-8 " ?> 

<!DOCTYPE  X3D  PUBLIC  "http : / /www . web3D . org/TaskGroups/x3d/translatlon/x3d-compact . dtd" 

"f ile : /  ^  ^  skGroups/x3d/translation/x3d-compact .dtd"> 

<X3D>  ^  -n  Root  Node  (explicit) 

<Scene>  I - ^ - 

<NavigationInf o  avatarSize="2  2  2"  speed="100"  type="EXAMINE  ANY"  visibilityLimit="60000"/> 

<Viewpoint 

description="ArrLphibious  raid  -  full  scenario  seen  from  above" 
orientation="-0.557  -0.799  -0.229  0.9506"  position="-600  10000  25000"/> 

<Viewpoint  description^" 1000m  elevation  view" 
orientation="0  1  0  -0.78" 
position="-200  1000  22000 "/><! --Viewl 

prototype  lets  us  find  good  viewpoint  Grouping  Node  for  Scene  Elements 

scene--><ProtoInstance  name="ViewPosi 
<fieldValue  name="enabled"  value="tri 
<Switch  whichChoice="0">< ! --M^^L|0rt^)with  all  players. --> 

<Group  DEF="EntireScene">  I 

Landterpi,  Terrain  Representation 

<Transform>  \ _ _ _ 

<Inline 

url=" Squot /Locat ion^CampPendletonCalif ornia/CampPendletonOperatingAreasExample . wrl&quot ; &#10; &quot ; http 
: / /web . nps . navy . mil/ -brut zman/ vrml/examples/NpsMilitaryModels /Locations /CampPendletonCalifornia/CampPendletonO 
perat ingAreasExample . wrl&quot / &#1 0 / &quot ;../.. /Locations /CampPendletonCalifornia/CampPendletonOper at ingAreasEx 
ample . xml & quo t / &# 10 / &quot / http : //web . nps . navy . mil/ ~brutzman/vrml/NpsMllltaryModels /Locations /CampPendletonCall 
fornia/CampPendletonOperat ingAreasExample . xml & quo t / &#1 0 ; " /> 

</Transform>< ! --====================  Ships  '  Amphibious  Ship 

<Transform  DEF="LPD"  translation=" 6600  10  1-4^^^^^^  I - 

<Inline  url="&quot/ . ./. ./Ships/LandingPlatformDock- 

LPD/LPD . wrl&quot / &#10 / &quot / http : //web . nps . navy . mil /~brutzman/vrml /examples /NpsMilitaryModels/ Ships /LandingPla 
tf ormDock-LPD/LPD . wrl&quot / &#10 / &quot / . ./. ./Ships/LandingPlatformDock- 

LPD/LPD .  xml  &  quo  t ;  &  #10  /  &quot  /  http :  /  /web .  nps  .  navy .  mil/~brut  zman/vrml/ example  si' i  ■  .i  ■  i  ■  /  m.  ■  .  ■  <t  .  ■  .i  ■  ■  ,  m  . 
tformDock-LPD/LPD.xml&quot; &#10;  "/>  ir»  nf  I  anHinn  Oroft 

</Transform><  !—====================  Amphibious  vehi^^^^^^^  LarOUp  OT  Lanaing  UraTt 

<Transform  DEF="AAAV-Location"  translation="6600  0 
<Viewpoint  description="Triple  AAAV  Raid" 

orientation="0  1  0  -1.57"  position="-40  2  0"/> 

<Transform  translation="0  -4  0"> 

<Inline  DEF="AAAV" 

url=" &quot ;../.. /AmphibiousVehicles/ AAAV/ AAAV. wrl&quot ; &#10; &quot ; http : / /web . nps . navy.mil/~brut  zman/vrml /examp 
les /NpsMilitaryModels /Amphibious Vehicles /AAAV/ AAAV. wrl&quot ; &#1 0 ; &quot ;../.. / Amphibi ousVehicles /AAAV/ AAAV. xml  & 
quot / &#10 / &quot / http : //web . nps . navy . mil/ ~brutzman/vrml/examples /NpsMilitaryModels /AmphibiousVehicles /AAAV/ AAAV 
. xml&quot ; &#10; " /> 

</Transform> 

<Group> 

<Transform  translation="-15  -4  -17.5">,^^rf^  i _ _ 

<Transform  DEF="AAAV-3">  i  •  i  i  i  i*  r. 

<usE  node="AAAvv>  ^  lodividual  Landipg  Crstt 

<Posit ioninterpolator  DEF="AAV-3PATH" 

key="0.00,  0.07,  0.13,  ...  "/>  I - 

</Transform> 

</Transform> 

<Transform  translation="-15  -4  15"> 

<Transform  DEF="AAAV-2"> 


Group  of  Landing  Craft 


Figure  5.  Excerpt  from  an  XML  file  describing  a  Marine  Corps  amphibious  operation.  Note 
that  the  same  content  is  being  described  as  in  Figures  3  and  4. 


broken  down  by  node  group  functionality  (for 
example  Geometry,  Lights,  Sounds)  and  include 
tests  of  browser  state,  field  range  testing, 
audio/graphical  rendering,  scene  graph  state, 
generated  events,  and  minimum  conformance 
requirements.  Each  test  consists  of  an  XML 
(X3D)  file,  its  equivalent  VRML97  file,  plus  an 
HTML  “pretty  print”  version  of  the  XML  content 
for  inspection.  Also  included  with  each  test  is  a 
complete  description  of  initial  conditions  and 
expected  results.  In  addition,  “sample  results”  in 
the  form  of  .jpg  or  .mpg  video  are  also  provided 
via  hyperlink  to  give  the  tester  a  complete 
“picture”  of  a  successful  test  result. 


Xj3D  Open  Source 

The  Web3D  Consortium  maintains  an  open- 
source  project  written  in  Java  called  Xj3D.  The 
Xj3D  codebase  enables  creation  of  a  test  bed  for 
researching  future  standards  and  specification 
work,  as  well  as  a  toolkit  that  allows  easy 
incorporation  of  VRML  content  into  other 
applications  (Couch  and  Hudson,  2001).  The 
source  code  is  freely  available,  inviting  technical 
collaboration,  reuse  and  contribution  by  Web3D 
developers.  Features  of  the  Xj3D  project  include: 
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Figure  6.  Amphibious  Raid  page  from  the  oniine  NPS  Miiitary  Modeis  directory  showing  a  portion  of 
the  XML  fiie  “pretty-printed”  in  HTML.  This  is  the  same  scenario  as  described  in  Figures  3,  4,  and  5, 
with  the  addition  of  a  representation  of  communications  capabiiities.  In  the  upper  right  corner  is  an 
active  3D  window  with  a  top-ievei  view  of  the  scenario  battiespace  (rendered  in  Netscape  Navigator 
using  the  CosmoPiayer  VRML  3D  piug-in). 


A  coiiection  of  parsers  for  VRML-syntax  fiies 
and  raw  fieid  information  ranging  from  strict 
to  ienient  specification  compiiance. 

A  generic  sequentiai  programming  interface 
with  caiibacks  as  various  parts  of  a  VRML 
stream  is  read. 

A  set  of  interfaces  that  represent  the  core 
node  concepts  of  the  VRML  specification. 

VRML  rendering  impiementations  currentiy 
have  Java3D  and  pure-memory 
impiementations,  with  an  OpenGL 
impiementation  possibie. 

An  independent  impiementation  of  the  XML 
Document  Object  Modei  (DOM)  that 
combines  both  DOM  and  Scene  Authoring 


Interface  (SAI)  access  to  the  same  graph.  Of 
note  is  that  the  SAI  is  an  Appiication 
Programmer  Interface  (API)  that  is  auto¬ 
generated  from  the  X3D  Schema. 

Separate  scripting  engine  supporting  Java 
and  Moziiia’s  Rhino  ECMAScript, 
independent  from  the  rendering  engine  used. 

Utiiity  ciasses  suppiementing  the  main  code 
(e.g.  user  interface  components). 

Having  an  open-source  impiementation  is 
tremendousiy  empowering  because  successfui 
specification  testing  and  vaiidation  is  no  ionger 
dependent  on  the  economic  “ups  and  downs”  of 
various  commerciai  3D  browser  companies. 
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SCENARIO  AUTHORING  AND  VISUALIZATION 

In  August  2000,  the  Defense  Modeling  and 
Simulation  Office  (DMSO)  Science  and 
Technology  Initiatives  program  provided  initial 
seed  funding  to  NPS  for  research  and 
development  of  a  scenario  authoring  and  Web- 
based  visualization  capability.  The  Marine  Corps 
Combat  Development  Command  (MCCDC) 
Training  and  Education  Command  (TECOM) 
originated  the  concept  for  the  project,  delineating 
a  requirement  for  3D  visualizations  of  the 
complex,  multi-dimensional  battlespace 
associated  with  Ship-to-Objective  Maneuver 
(STOM)  and  other  emerging  Marine  Corps 
operations.  The  NPS  project  is  called  Scenario 
Authoring  and  Visualization  for  Advanced 
Graphical  Environments  (SAVAGE). 

Marine  Corps  expeditionary  warfare 
education  and  training  is  being  modernized  to 
deal  with  the  air/ground/sea  complexities  of  the 
modern  littoral  battlespace.  The  Marine  Corps 
has  initiated  a  Distance  Learning  program  to 
support  Marine  Corps  training  and  education.  The 
program  seeks  to  integrate  the  use  of  innovative 
instructional  technology  to  support  distance¬ 
learning  requirements.  The  Marine  Corps  Mission 
Needs  Statement  for  Multimedia  Infrastructure 
(USMC,  1994)  states  that  the  Marine  Corps  must 
capitalize  on  “an  environment  of  graphics,  visual 
displays,  information  call-up,  filtering, 
interpretation,  and  computerized  dissemination.” 
Moreover,  the  Mission  Needs  Statement  cites  the 
“emergence  of  modeling  and  simulation  virtual 
realities”  as  “one  example  of  the  need  to  support 
technology  delivery  through  classroom 
environments  that  can  support  the  concept  as 
well  as  the  idea.”  One  envisions  the  creation  of 
virtual  classrooms  where  the  student  warfighter  is 
able  to  investigate  and  explore  tactical  mission 
planning  and  execution  anytime,  anywhere.  In 
addition  to  military  education,  there  is  also  a  need 
to  educate  the  general  public  in  the  nature  of 
Marine  Corps  operations. 

The  SAVAGE  project  seeks  to  exploit  the 
concepts  and  techniques  of  on-line  gaming  and 
virtual  worlds  to  create  an  environment  for 
exploration  of  the  battlespace.  Users  may  be 
members  of  a  command  staff  or  civilians 
interested  in  understanding  the  nature  of 
extended  littoral  operations.  Users  will  be  able  to 
work  individually  or  collaborate  to  create  the 
representation  of  the  battlespace.  The  purpose  is 
not  to  create  “yet  another”  combat  model,  but  to 


provide  a  means  to  create  a  representation  of  the 
battlespace  that  can  be  explored  and 
manipulated  (virtual  “shaping  of  the  battlespace”). 
Follow-on  efforts  include  interfacing  the  tool  to 
one  or  more  existing  or  emerging  combat 
simulations,  so  that  scenarios  may  be  created  in 
a  common  environment  and  executed  in  multiple 
environments. 

The  scenario  authoring  and  visualization  tool 
must  be  simplistic  and  intuitive  in  operation,  yet 
rich  in  representation  to  capture  the  complexities 
of  the  modern  battlefield.  The  tool  must  operate 
effectively  in  a  networked  environment  to  enable 
multi-user  interactions  and  collaboration  in 
creation  of  scenario  elements  and  for  playback  of 
scenario  events  and  actions. 

Authoring  Component 

The  scenario  authoring  component  will 
enable  subject  matter  experts  (SMEs)  to  create 
graphical  representations  of  the  extended  littoral 
battlespace,  including  terrain,  weather,  and 
forces.  The  SMEs  are  similar  to  film  directors, 
using  the  tool  to  lay  out  the  story-line  (missions), 
cast  (forces),  setting  (environment  -  terrain, 
weather),  and  scenes  (key  objectives  and 
events),  within  the  digital  medium.  The  SMEs 
configure  the  forces  and  assign  missions  and 
actions,  drilling  down  to  the  lowest  unit  that  is 
desired  for  formulation  and  assignment  of 
planned  actions  in  detail.  Represented  activities 
include  embarkation,  debarkation,  movement, 
assault,  fires,  engineering,  intelligence,  and 
logistics. 

The  tool  will  provide  2D  and  3D  views  of  the 
battlespace  for  force  placement,  route  planning, 
assignment  of  missions,  and  exploration.  SMEs 
will  be  able  to  collaborate  by  sharing  views  and 
graphical  annotations  over  local  area  or  wide- 
area  networks.  Timelines  are  built  for  operational 
maneuver  from  the  sea,  coordinated  fires,  air 
strikes,  and  subsequent  movements  ashore.  For 
example,  members  of  a  team  may  be  responsible 
for  different  functional  areas  in  the  plan  (fires, 
maneuver,  intelligence,  etc.).  Each  user  can 
identify  the  forces  and  behaviors  to  perform  their 
assigned  area  of  responsibility,  and  then  the 
functional  areas  can  be  introduced  as  separate 
“layers”  over  the  battlespace.  Visualization  of  the 
layers  individually  and  in  various  combinations, 
with  the  added  dimension  of  time,  will  allow  the 
participants  to  identify  resource  and  space/time 
conflicts  in  the  battlespace. 
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Products  of  the  authoring  activity  may  differ 
in  ievei  of  interaction  aiiowed  to  the  viewer.  At 
one  extreme,  authors  can  produce  a  scripted 
presentation  of  the  scenario,  with  preset 
viewpoints  aiiowing  iittie  or  no  user  interaction 
with  the  scene  other  than  to  use  video  piayer 
controis  (pause,  piay,  fast-forward,  rewind).  At  the 
other  extreme,  authors  can  produce  a  scenario 
that  aiiows  the  user  to  “step  into”  the  scene, 
taking  controi  of  the  movement  and  actions  of  an 
entity  or  force  within  the  scenario.  Different  ieveis 
of  interactivity  between  these  two  extremes  are 
possibie,  and  wiii  be  determined  by  the  scenario 
author. 

The  Department  of  Defense  is  currentiy 
converting  standard  United  States  Message  Text 
Format  (USMTF)  messages  into  XML  (XML-MTF, 
2001).  Research  at  NPS  has  shown  the  potentiai 
of  autotransiating  3D  modeis  directiy  from 
USMTF  operations-order  messages  (Murray  and 
Quigiey,  2000)  and  from  tacticai  communications 
pianning  systems  (Lafiam,  2000,  and 
Hunsberger,  2001).  In  a  coiiaborative  effort  with 
the  Navai  Undersea  Warfare  Center  (NUWC)  and 
NPS,  the  Institute  for  Defense  Anaiysis  (IDA)  has 
created  an  XML-based  Land  Command  and 
Control  Information  Exchange  Data  Model 
(LC2IEDM;  IDA,  2000)  to  form  a  basis  for 
interoperability  among  command  and  control 
systems.  NUWC  is  extending  this  model  to  also 
support  the  Maritime  domain. 

In  the  SAVAGE  project,  an  XML 
representation  of  an  amphibious  operation  order 
is  of  particular  interest.  One  challenge  is  that 
much  of  the  important  information  in  the 
operation  order  is  contained  in  the  unstructured 
free-text  portion  of  the  order.  Work  is  needed  to 
integrate  various  XML  schemas  to  precisely  tag 
the  semantics  of  important  information.  This  is  a 
major  challenge  because  each  service  varies  the 
amount  and  type  of  information  contained  in  the 
general  text  section.  Nevertheless,  the  broad 
applicability  of  both  XML-MTF  and  LC2IEDM 
make  such  a  task  feasible. 

In  addition  to  these  exciting  developments,  a 
number  of  programs  are  underway  in  the 
Department  of  Defense  to  define  a  common  XML 
tagset  for  scenario  descriptions  to  facilitate 
interoperability  among  simulation  systems  and 
command  and  control  systems.  Two  efforts  are 
being  monitored  closely  for  applicability  to  the 
SAVAGE  project:  (1)  Joint  Simulation  System 


(JSIMS)  Common  Control  Workstation  (CCWS) 
scenario  generation  (JSIMS,  2000);  (2)  DMSO 
dynamic  scenario  builder  initiatives  (Lacy,  Stone, 
and  Dugone,  1999,  and  Lacy  and  Dugone,  2001). 
It  is  expected  that  these  efforts  will  provide  a  set 
of  abstractions  describing  scenario  elements, 
from  which  an  XML-based  tool,  such  as  the  X3D 
editor  shown  in  Figure  3,  can  be  configured  to 
enable  a  user  to  construct  the  scenario  in  a 
hierarchical  manner  with  time  sequenced 
behaviors.  The  resulting  XML  file  can  then  be 
manipulated  in  any  number  of  ways,  including 
transformation  into  VRML  structures  for  3D 
visualization. 

Available  planning  data  from  other  sources 
can  be  used  to  assist  scenario  generation.  Such 
sources  may  include  the  Contingency  Theater  Air 
Planning  System  (CTAPS)  Air  Tasking  Order 
(ATO),  Time-Phased  Force  Deployment  Data 
(TPFDD),  or  emerging  concepts  such  as  Effects 
Tasking  Order  and  Maritime  Tasking  Order. 

Clearly,  strategic  opportunities  for  coherently 
connecting  diverse  systems  and  data  sources  are 
emerging.  It  is  compelling  to  think  that  networked 
3D  visualizations  of  all  standardized  orders  and 
plans  might  soon  be  available  to  all  commands, 
provided  as  simple  message  attachments. 

Visualization  Component 

Today’s  planning  and  modeling  systems  most 
often  use  2D  representations  of  the  3D 
battlespace.  This  presents  a  challenge  for 
planners,  commanders,  and  troops  to  understand 
the  true  nature  of  the  battlespace  with  regard  to 
best  routes,  cover  and  concealment,  obstacles, 
and  probable  enemy  strongpoints.  While  the 
SAVAGE  visualization  component  will  offer  the 
ability  to  toggle  between  2D  and  3D  views  of  the 
battlespace,  it  is  the  added  benefits  that  3D  offers 
that  make  this  visualization  component  so  unique 
and  robust. 

Once  authoring  is  complete,  the  XML  to 
VRML  translation  is  invisible  and  automatic.  A  3D 
plug-in,  such  as  Cosmo  Player,  Cortona,  or 
Contact,  must  be  loaded  on  the  user’s  computer 
to  view  the  3D  battlespace.  Using 
communications  protocols  such  as  the  DIS,  the 
local  computer  or  any  other  computer  that  it  may 
be  networked  to  can  see  and  manipulate  the 
same  3D  environment.  The  visualization 
component  reuses  graphical,  database,  and 
scenario  control  elements  provided  in  the 
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scenario-authoring  component,  but  wiii  disabie 
scenario  definition  eiements  for  the  common 
user. 

The  user  wiii  navigate  the  virtuai  battiespace 
using  predefined  or  freeform  fiy-over  (“magic 
carpet”),  by  accessing  a  predefined  set  of  static 
viewpoints,  or  by  taking  the  perspective  of  a 
particuiar  unit  or  entity  in  the  battiespace.  The 
user  can  query  meta-data  encapsuiated  in  the 
battiespace  objects  to  obtain  mission  and  status 
information  (What  am  I?  Where  am  I?  Where  am 
I  going?  What  is  my  mission?  What  is  my 
firepower?  What  is  my  organization?  What  is  my 
ioad?  What  is  my  knowiedge  of  the  enemy?). 
Objects  can  be  driven  by  embedded  behaviors 
defined  by  the  scenario  author,  or  the  user  may 
intervene  and  directiy  controi  objects  in  the 
scenario.  By  zooming  in  or  out,  the  user  can 
choose  the  ievei  of  visuaiization  detaii  desired. 

As  the  scenario  unfoids,  the  visuaiization 
component  wiii  dispiay  resource  assignment 
confiicts,  time  iags,  suppiy  probiems,  and  other 
battiespace  issues.  Event  confiicts  wiii  “pop-up” 
on  the  dispiay  at  the  iocation  and  time  of 
occurrence.  The  measures  of  interest  may  be 
seiected  from  a  predefined  set,  or  defined  based 
on  the  system  database  schema,  to  configure  the 
feedback  in  a  taiiy  board  for  a  particuiar 
operation.  Options  wiii  aiiow  the  user  to 
reconstruct  and  dispiay  event  tracks. 

The  user  may  stop,  rewind,  pause,  and  repiay 
the  scenario.  When  reviewing  a  scenario,  authors 
may  rewind  a  scene,  toggie  over  to  the  authoring 
component,  make  a  change,  and  toggie  back  to 
the  visuaiization  component  to  view  the  resuits  of 
the  changes.  Note  that  the  fuii  set  of  visuaiization 
capabiiities  wiii  be  avaiiabie  to  scenario  authors 
to  faciiitate  deveiopment  of  the  scenarios. 

Tool  Prototyping 

NPS  efforts  during  the  first  year  of  the 
SAVAGE  project  have  focused  on  the 
visuaiization  side  of  the  probiem.  The  goai  was  to 
obtain  a  better  understanding  of  the  visuai 
eiements  of  the  battiespace  that  need  to  be 
represented  to  provide  effective  content.  As  the 
visuai  representation  of  a  scenario  was 
constructed,  the  nature  and  scope  of  toois 
needed  to  assist  in  authoring  a  scenario  became 


dearer.  The  work  has  resuited  in  representation 
of  a  smaii  scenario,  numerous  3D  modeis  of 
miiitary  piatforms,  and  an  initiai  set  of  VRML 
extensions  (through  the  PROTO  mechanism)  to 
faciiitate  scenario  authoring.  The  foiiowing 
discussion  describes  work  accompiished  to  date 
and  research  directions  for  the  project. 

As  an  initiai  exempiar,  the  project  team 
seiected  a  smaii  amphibious  raid  scenario.  Study 
of  Marine  Corps  and  Navy  pubiications  (Navai 
Warfare  Pubiication  3-02.1  and  Amphibious 
Warfare  Schooi  Course  8603)  resuited  in 
description  of  the  principai  stages  of  the 
operation;  for  exampie,  iaunching  a  heiicopter 
patroi,  iaunching  ianding  craft,  scouting  the  beach 
approach,  and  so  on.  Each  key  event  in  the 
amphibious  raid  operation  was  treated  as  a 
separate  scene.  Storyboards  were  deveioped  to 
document  and  depict  eiements  of  each  scene. 
Each  storyboard  inciuded: 

A  textuai  description  of  the  scene  using 
terminoiogy  from  the  doctrinai  pubiications 

A  hand-drawn  sketch  of  the  scene 

One  or  more  photographs  of  the  scene  from 
reai-worid  miiitary  operations,  inciuding  a  set 
of  photographs  taken  during  a  Capabiiities 
Exercise  at  Camp  Pendieton  in  December 
2000 

A  static  3D  rendering  of  the  scene,  deveioped 
using  the  X3D  Edit  tooi  (Figure  3) 

Storyboard  depictions  heiped  the 
deveiopment  team  understand  the  amphibious 
doctrine  invoived,  and  cieariy  indicated  the 
objects,  conditions,  and  behaviors  that  wouid 
need  to  be  represented.  Moreover,  transitions 
from  one  scene  to  the  next  heiped  define 
positionai  changes  and  timing  for  animation  of 
the  eiements  in  the  scenes. 

Figure  7  shows  a  sketch  of  ianding  craft 
being  iaunched  from  the  weii  deck  of  an 
amphibious  ship.  Figure  8  shows  a  photograph 
taken  during  a  Marine  Corps  Capabiiities 
Exercise  at  Camp  Pendieton  in  December  2000. 
A  3D  depiction  of  the  scene  with  a  simpiified  LPD 
modei  is  shown  in  Figure  9. 
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Figure  7.  Storyboard  sketch  of  landing  craft 
exiting  the  well  deck  of  an  amphibious  ship. 


Figure  8.  Storyboard  photograph  from  a 
Marine  Corps  Capabilities  Exercise  at  Camp 
Pendleton  in  December  2000. 


Figure  9.  Storyboard  3D  rendering  of  an 
AAAV  launch  from  a  simplified  model  of  an 
LPD-17  amphibious  ship,  with  transparent 
ocean  surface  and  Camp  Pendleton  terrain. 


One  of  the  advantages  of  a  synthetic 
battlespace  is  the  opportunity  to  examine  future 
platforms.  For  prototyping  purposes,  we  decided 
to  depict  the  new  LPD-17  class  amphibious 
platform,  as  well  as  the  Advanced  Amphibious 
Assault  Vehicles  (AAAVs).  These  systems  are 
currently  in  procurement,  and  will  not  be 
delivered  to  the  Fleet  for  several  years.  However, 
in  the  virtual  battlespace,  we  can  examine  the 
operational  characteristics  of  these  platforms 
now. 

Another  choice  made  in  the  creation  of  the 
3D  scene  shown  in  Figure  9  was  to  use  color 
mapping  to  indicate  bathymetry  data.  In  order  to 
see  the  coloration,  the  ocean  surface  is 
transparent  (which  is  why  the  entire  hull  of  the 
LPD  is  visible).  The  virtual  battlespace  enables 
the  user  to  see  dimensions  that  have  not  been 
readily  available  in  the  past.  As  the  project 
proceeds,  the  team  will  identify  sets  of 
information  or  feature  selections  that  should  be 
made  available  to  the  user  to  allow  him/her  to 
choose  which  aspects  of  the  battlespace  to  view, 
in  isolation  or  in  combination  with  other  features. 

Figure  10  shows  an  AAAV  on  the  beach.  It  is 
worth  mentioning  that  the  3D  models  used  in  the 
SAVAGE  project  have  been  created  by  students 
and  faculty  at  NPS  (using  the  X3D  Editing  tool 
shown  in  Figure  3).  The  project  is  not  employing 
a  staff  of  3D  artists  to  do  this  work.  Since  the 
research  is  concerned  with  how  to  more  readily 
and  effectively  develop  meaningful  3D  content,  a 
good  measure  of  success  is  the  ability  for  new 
students  (with  military  backgrounds,  but  not 
trained  artists)  to  be  able  to  create  content. 
Through  coursework,  student  projects,  student 
theses,  and  faculty  research,  NPS  is  building  a 
collection  of  freely  available,  reusable 
components  that  can  be  used  to  rapidly  create 
content  (currently,  over  275  models  and  tools  to 
use  as  building  blocks  in  creation  of  scenarios). 
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OTHER  APPLICATIONS  TO  MILITARY 
EDUCATION  AND  TRAINING 


Figure  10.  Storyboard  3D  rendering  of  AAAV 
coming  ashore  at  Camp  Pendieton’s  Red 
Beach,  with  heiicopter  route  iines  overhead 
(AAAV  modei  has  articuiated  tracks,  turret, 
and  front  and  rear  pianing  extensions  for 
high-speed  water  movement). 

In  creation  of  the  exempiar  scene,  the  project 
team  deveioped  a  number  of  extensions  to  VRML 
to  faciiitate  the  authoring,  inciuding:  (1)  a 
WayPointInterpoiator,  enabiing  an  author  to 
describe  the  pianned  movement  of  one  or  more 
piatforms;  (2)  a  BooieanSequencer  and 
IntegerSequencer,  providing  a  mechanism  for 
sending  signais  to  nodes  in  the  scene  graph  to 
activate  or  modify  behaviors  in  the  scenario;  (3) 
an  ExecutionControi,  providing  user  controis  to 
run,  pause,  rewind,  and  fast-forward  the  scenario; 
(4)  CameraCompass  heads-up  dispiay  to  provide 
a  visuai  indication  of  the  direction  the  user  is 
viewing. 

A  number  of  enhancements  are  in  progress, 
inciuding:  (1)  user  controi  over  the  execution 
mode  of  a  scene,  enabiing  the  user  to  indicate  if 
the  scene  is  running  iocaiiy  (off  its  own  timers), 
with  or  without  acting  as  a  DIS  Protocoi  Data  Unit 
(PDU)  writer  (master),  or  as  a  DIS  PDU  receiver 
(ghost);  (2)  extension  of  the  DIS  Entity  State  PDU 
Transform  (EspduTransform)  to  permit  the  user 
to  modify  read/write  time  intervais  and  to  change 
operation  mode  (iocai,  master,  ghost).  These 
changes  wiii  enabie  the  scenario  to  execute  over 
a  network  so  that  muitipie  users  may  participate 
in  the  scenario  simuitaneousiy. 


Web-based  3D  visuaiizations  wiii  enhance  a 
broad  set  of  miiitary  education  and  training  topics 
by  making  dynamic  battiespaces  avaiiabie 
anytime,  anywhere  through  network  access.  In 
addition  to  directiy  supporting  Distance  Learning 
initiatives,  the  capabiiity  to  create  and  expiore 
dynamic  battiespaces  enabies  creation  of  virtuai 
command  and  controi  environments  for 
command  staff  training  (Biais  and  Garrabrants, 
2000).  Other  key  target  areas  of  interest  to  NPS 
inciude  education  in  mission  pianning  and 
rehearsai  for  amphibious  operations,  3D 
visuaiization  for  Miiitary  Operations  in  Urban 
Terrain  (MOUT),  and  deveiopment  of  3D 
visuaiization  for  seiected  simuiation  systems. 

Mission  Planning  and  Rehearsal  Tool  for 
Amphibious  Operations 

Amphibious  assauit  operations  are  especiaiiy 
difficuit  to  execute  because  of  limited  abiiities  to 
conduct  rehearsais.  This  piaces  a  premium  on 
pianning.  Web3D  can  improve  amphibious 
assauit  preparation  by  providing  a  tooi  to  mission 
pianners  to  better  convey  operationai  concepts  to 
individuai  units  as  weii  as  capture  the  overaii 
operation.  3D  visuaiization  of  the  terrain 
combined  with  physicaiiy  based  modeis  can 
provide  criticai  information  not  readiiy  apparent 
with  current  two-dimensionai  pianning 
techniques.  This  inciudes:  route  pianning, 
recommended  seiection  of  firing  positions,  pre¬ 
positioning  of  reconnaissance  teams,  and 
deconfiiction  of  ground,  sea,  and  air  forces. 

Military  Operations  In  Urban  Terrain  (MOUT) 

The  combination  of  urban  terrain  and 
ambiguous  environments,  where  identification  of 
combatants  is  not  aiways  ciear,  normaiiy  make 
MOUT  a  difficuit  and  arduous  operation.  Web3D 
is  particuiariy  weii  suited  as  a  pianning  and 
rehearsai  tooi  for  reducing  operationai  risk.  It  can 
do  so  in  severai  ways: 

Close  Quarter  Combat  (CQC).  Assauiting  a 
buiiding  for  hostage  rescue  or  to  secure  a  series 
of  buiidings  takes  detaiied  pianning  and 
rehearsai.  Estabiishment  of  fieids  of  fire  can  be 
criticai  to  minimizing  casuaities.  Web3D  can 
accurateiy  modei  the  interior  and  exterior  of  the 
buiiding  to  faciiitate  pianning  and  “waik-through” 
rehearsais. 
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Route  Planning.  A  Web3D  map  of  city  streets 
can  assist  foot  and  vehicuiar  patrois  in 
estabiishing  ingress  and  egress  routes.  It  can  aiso 
provide  accurate  contingency  training  for 
mistakes  in  navigation. 

Spotter/Firing  Positions.  Web3D  can  give 
reconnaissance  and  sniper  teams  the  abiiity  to 
seiect  the  best  avaiiabie  positions,  as  weii  as 
determine  positions  the  enemy  is  iikeiy  to  be 
postured.  This  can  be  especiaiiy  difficuit  in  urban 
terrain  where  it  is  difficuit  to  estimate  range  of 
view  and  firing  positions  from  overhead  imagery. 
3D  mapping  can  put  the  warfighter  at  the 
simuiated  position  to  assess  its  feasibiiity. 

Rapid  3D  Visualization.  It  currently  takes  a 
significant  amount  of  time  to  create  a  3D 
visualization  of  a  large  urban  area.  Unless 
accomplished  prior  to  the  start  of  operations,  it 
would  not  be  available  for  initial  missions.  It  may 
be  possible  to  rapidly  develop  Web3D 
visualization  of  urban  terrain  using  an  accurate 
overhead  database.  This  would  be  updated  with 
the  latest  available  information  to  provide  forces 
with  an  ideal  planning  and  rehearsal  tool.  For 
education  in  MOUT  tactics,  synthetic  urban  areas 
may  be  “grown”  from  specifications  of  general 
characteristics  of  the  built-up  area  (terrain 
features,  population  density,  construction 
materials,  etc.)  using  techniques  similar  to 
commercial  game  simulations. 


Figure  11.  USS  Greeneville  in  a  reconstruction 
of  the  tracks  in  the  USS  GREENVEVILLE  - 
MV  Ehime  Maru  collision.  The  user  can  adjust 
sea-state  levels  to  observe  effects  on  the 
ability  to  view  surface  contacts  through  a 
virtual  oeriscooe. 


3D  Visualization  of  Simulation  Systems 

There  are  a  number  a  simulation  models  that 
can  provide  Tactical  Decision  Aids  to  the 
warfighter.  These  can  be  enhanced  through  the 
introduction  of  Web3D  capabilities.  For  example, 
the  Naval  Simulation  System  (NSS)  is  a  good 
candidate  for  augmentation  with  3D  visualization. 
NSS  is  designed  to  support  Naval  and  Joint 
operations  planning  and  decision  support,  C4ISR 
analyses/assessments.  Fleet  exercise  and 
experiments,  and  Fleet  Training. 

NSS  currently  provides  a  2D  scenario 
mapping  of  the  simulation  runs.  Incorporating  3D 
visualization  of  the  scenario  to  the  system  would 
enhance  the  user  interface  and,  in  combination 
with  accurate  terrain  models,  could  provide  the 
user  with  better  understanding  of  the  simulation 
results. 

Other  Application  Domains 

New  generations  of  students  are  making  their 
way  through  our  educational  systems.  These 
students  are  familiar  with  a  world  of  high-speed 
personal  computers  and  Internet  access  that 
provides  media-rich  digital  visual  and  interactive 
experiences.  These  students  and  future  members 
of  the  workforce  are  expecting  the  same  from  the 
educational  and  employment  environments 
(Prensky,  2001).  The  techniques  discussed  in  this 
paper  may  be  applied  to  any  story-telling  venue. 
As  discussed  at  the  outset,  the  key  issue  today  is 
interactivity  -  the  user  must  have  a  sense  of 
involvement  in  the  delivery  of  the  instructional 
material,  regardless  of  the  domain. 

Students  at  NPS  have  examined  accounts  of 
the  USS  GREENEVILLE/MV  Ehime  Maru 
collision  and  are  constructing  a  3D  recreation  of 
the  incident  (Figure  11).  Although  this  incident 
falls  within  the  military  domain,  it  illustrates  the 
applicability  of  the  technology  to  a  much  broader 
set  of  learning  situations. 

FUTURE  PLANS 

The  SAVAGE  project  is  a  long-term  research 
program  seeking  to  push  the  frontier  of  Web- 
based  3D  scenario  authoring  and  visualization.  In 
addition  to  the  numerous  models  and  case-study 
examples  previously  described,  planned 
directions  for  the  work  include: 
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■  Expanding  the  palette  of  models  and  events 
that  can  be  inserted  into  a  scenario,  including 
representation  of  control  measures  and  other 
non-physical  concepts  in  the  battlespace. 

■  Creating  scenarios  of  greater  complexity 
depicting  the  interplay  of  represented  land, 
air,  sea,  and  littoral  objects  and  operations. 
Include  the  interaction  of  operations  with 
control  measures. 

■  Creating  branching  flows  in  the  scenario 
script  to  present  decision  points  that  engage 
the  user  in  the  unfolding  scenario. 

■  Adapting  the  multi-user  architecture  to 
employ  the  High-Level  Architecture  (HLA). 

■  Investigating  assignment  of  behaviors  to 
scenario  objects;  for  example,  from  XML 
libraries  of  pre-scripted  actions  (see  Lacy  and 
Pearman,  2000)  with  adaptation  mechanisms 
to  the  current  situation. 

■  Developing  techniques  for  rapidly  generating 
battlespace  terrain,  to  include  representation 
of  built-up  areas  and  vegetation  cover,  for 
use  in  the  WebSD  environment. 

-  Automating  extraction  of  scenario  information 
from  doctrinal  operations  orders  and  plans. 

CONCLUSIONS 

WebSD  graphics  have  finally  come  of  age 
due  to  widespread  hardware  acceleration  and 
interoperable  3D  content  using  X3D/VRML, 
mostly  thanks  to  open-standards  efforts 
sponsored  by  the  Web3D  Consortium.  The  NPS 
SAVAGE  project  (in  partnership  with  multiple 
collaborators)  demonstrates  that  across-the-board 
integration  of  operational  planning,  message 
systems,  worldwide  command  and  control 
systems,  and  networked  3D  visualization  is  a 
powerful  use  of  XML-based  standards.  These 
amazing  hardware  and  software  capabilities  open 
a  range  of  opportunities  for  enhanced  educational 
experiences  through  powerful  Web-enabled 
technologies. 

REFERENCES 

Ames,  A.,  Nadeau,  D.  &  Moreland,  J.  (1997). 
VRML  2.0  Sourcebook  (2"'^  ed.).  New  York:  John 
Wiley  &  Sons. 


Blais,  C.  L.,  &  Garrabrants,  W.  M.  (2000). 
Stimulating  C4I:  Simulation’s  Role  In  Distance 
Learning.  In  M.  Chinni  (Ed.),  Proceedings  of  the 
Advanced  Simulation  Technologies  Conference 
2000  (pp  205-210).  San  Diego,  California: 
Society  for  Computer  Simulation,  205-210. 

Brutzman,  D.  (1998,  June).  The  Virtual 
Reality  Modeling  Language  and  Java. 
Communications  of  the  ACM,  41 :6,  57-64. 

Carey,  R.,  &  Bell,  G.  (1997).  Annotated 
VRML  2.0  Reference  Manual.  Reading, 
Massachusetts:  Addison-Wesley. 

Couch,  J.,  &  Hudson,  A.  (2001,  draft). 
Viewing  and  Incorporating  VRML  Content  with 
Xj3D. 

Deitel,  H.  M.,  Deitel,  P.  J.,  Nieto,  T.  R.,  Lin, 
T.  M.,  &  Sadhu,  P.  (2001).  XML  How  to  Program. 
Upper  Saddle  River,  New  Jersey:  Prentice  Hall. 

Foley,  J.  D.,  van  Dam,  A.,  Feiner,  S.  K.,  & 
Hughes,  J.  F.  (1990).  Computer  Graphics 
Principles  and  Practice  (2nd  ed.).  Reading, 
Massachusetts:  Addison-Wesley. 

Goldfarb,  C.  F.,  &  Prescod,  P.  (2001).  The 
XML  Handbook  (2"''  ed.).  Upper  Saddle  River, 
New  Jersey:  Prentice  Hall  PTR. 

Hunsberger,  M.  G.  (2001,  June).  3D 
Visualization  Of  Tactical  Communications  For 
Planning  And  Operations  Using  Virtual  Reality 
Modeling  Language  (VRML)  and  Extensible  3D 
(X3D).  Monterey,  California:  Naval  Postgraduate 
School. 

IDA  (2000,  July).  Overview  of  the  Land  C^ 
Information  Exchange  Data  Model.  Institute  for 
Defense  Analyses. 

IEEE  (1996).  IEEE  Standard  For  Distributed 
Interactive  Simulation  Application  Protocols. 
IEEE  Std  1278.1-1995.  Institute  of  Electrical  and 
Electronic  Engineers. 

JSIMS  (2000,  October  3  draft).  Battlespace 
XML  schema.  Orlando,  Florida:  Joint  Simulation 
System  (JSIMS)  Common  Controller  Work 
Station  (CCWS)  Scenario  Generation  Team. 

Katz,  W.  (1998).  Networked  Synthetic 
Environments:  from  DARPA  to  your  Virtuai 
Neighborhood  (pp  115-127).  In  C.  Dodsworth 
(Ed.),  Digital  Illusions.  Reading,  Massachusetts: 
Addison-Wesley. 

Lacy,  L.,  Stone,  G.,  &  Dugone,  T.  D.  (1999, 
September).  Sharing  HLA  Scenario  Data.  In 
Proceedings  of  the  Fall  1999  Simulation 
Interoperability  Workshop.  Paper  99F-SIW-190. 

Lacy,  L.,  &  Pearman,  G.  M.  (2000, 

September).  Computer-Generated  Forces 
Behavior  Representation  And  Reuse  Using  The 
Extensibie  Markup  Language  (XML).  In 


17 


Proceedings  of  the  Fall  2000  Simulation 

Interoperability  Workshop.  Paper  OOF-SIW-121 . 

Lacy,  L.  W.,  &  Dugone,  T.  D.  (2001,  May 
draft).  Military  Scenario  Definition  Language. 
Monterey,  California:  US  Army  TRADOC 
Analysis  Center. 

Laflam,  D.  (2000,  September).  3D 
Visualization  Of  Theater-Level  Radio 
Communications  Using  A  Networked  Virtual 
Environment.  Master’s  Thesis.  Monterey, 
California:  Naval  Postgraduate  School. 

Miller,  T.  E.  (2000,  September).  Integrating 
Realistic  Human  Group  Behaviors  Into  A 
Networked  3D  Virtual  Environment.  Master’s 
Thesis.  Monterey,  California:  Naval  Postgraduate 
School. 

Murray,  M.  W.,  &  Quigley,  J.  M.  (2000,  June). 
Automatically  Generating  A  Distributed  3D 
Battlespace  Using  USMTF  And  XML-MTFAIR 
Tasking  Order,  Extensible  Markup  Language 
(XML)  And  Virtual  Reality  Markup  Language 
(VRML).  Monterey,  California:  Naval 

Postgraduate  School. 

Prensky,  M.  (2001).  Digital  Game-Based 
Learning.  New  York:  McGraw-Hill. 

Task  Force  ‘W’  (Web)  (2001,  January).  Web- 
enabled  navy  architecture,  version  2.0.  Vice 
Chief  of  Naval  Operations. 

http://www.tfw.navv.mil 

USMC  (1994,  August).  Multimedia 
Infrastructure  Mission  Need  Statement.  TNG 
1 .23.  United  States  Marine  Corps. 

VRML  (1997,  December).  VRML  97 
International  Specification.  ISO/IEC  14772-1. 

Walsh,  A.  E.,  and  Bourges-Sevenier,  M. 
(2001).  Core  Web3D.  Upper  Saddle  River,  New 
Jersey:  Prentice-Hall. 

XML-MTF  (2001).  Principles  and  Eerivations 
in  support  of  XML-MTF.  XML-MTF  Development 
Team.  Reston,  Virginia:  Mitre  Corporation. 

Zeltzer,  D.  (1992,  Winter).  Autonomy, 
interaction,  and  presence.  Presence  1 :1 .  MIT 
Press. 


ACKNOWLEDGMENTS 


The  authors  are  grateful  to  Dr.  Phil  Barry  of 
the  Defense  Modeling  and  Simulation  Office 
(DMSO),  Dr.  Mike  Bailey  of  the  Marine  Corps 
Training  and  Education  Command  (TECOM), 
Walt  Zimmers  at  the  Defense  Threat  Reduction 
Agency  (DTRA),  and  Erik  Chaum  of  the  Naval 
Undersea  Warfare  Center  (NUWC)  for  supporting 
this  research.  Also,  to  the  Naval  Postgraduate 
School  Institute  for  Joint  Warfare  Analysis  (IJWA) 
and  the  Modeling,  Virtual  Environments  and 
Simulation  (MOVES)  Institute  for  ongoing 
financial  and  administrative  support  to  this  work. 
Thanks  to  Dr.  Mark  Pullen  and  Dr.  Robert  Simon 
of  George  Mason  University  (GMU),  as  well  as 
Dr.  Francisco  Loaiza  and  Dr.  Gene  Simaitis  of 
Institute  for  Defense  Analyses  (IDA),  for  their 
collaborative  research  efforts  which  complement 
this  project.  Thanks  to  Alan  Hudson,  Justin 
Couch  and  Stephen  Matsuba  of  Yumetech  for 
their  work  on  the  Xj3D  browser.  Thanks  to 
Jonathan  Roberts,  Jeff  Weekley,  Jane  Wu  and 
Etsuko  Lippi,  ROLANDS  &  ASSOCIATES 
Corporation,  for  their  many  contributions  to  the 
Savage  project.  The  views  expressed  in  this 
document  are  solely  those  of  the  authors  and  do 
not  necessarily  reflect  the  opinion  or  policy  of 
NPS  or  the  other  associated  organizations. 


18 


